Developing a Test Collection for the Evaluation of Integrated Search
نویسندگان
چکیده
The poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 160,000 papers and journal articles in PDF and 275,000 abstracts with a varied set of metadata and vocabularies from the physics domain, 65 topics based on real work tasks and corresponding graded relevance assessments. The test collection may be used for systemsas well as user-oriented evaluation.
منابع مشابه
Developing an Integrated Process for Organizational Experience Documentation: Experience Management Approach
The purpose of this study is to develop an integrated experience documentation process as a basis for designing and implementing experience documentation in organizations. The research method used was qualitative which is a type of meta-study known as meta-synthesis. After designing the research questions, systematic search was carried out among researches and 28 were selected based on purposef...
متن کاملAn Integrated Approach for Collection Center Selection in Reverse Logistics
In this paper, a hybrid multi-criteria decision-making (MCDM)-method and mixed integer linear programming (MILP) approach in order to evaluation of the returned products' collectors along with their ordered quantities, is utilized. Firstly, the most important criteria of collection center in the car industry are identified. Then, in order to evaluate these proposed criteria, a hybrid Fuzzy Deci...
متن کاملAdjustment and Growth: Macroeconomic Performance of the IMF and World Bank Integrated model for Selected Mediterranean and MENA Developing Countries
accentuate on the programs advocated by the IMF and the World Bank from the model known as the "Integrated Model IMF-World Bank". This research makes a comprehensive evaluation of the applicability of this model to analyze the performance of adjustment programs in the case of six countries in the Mediterranean and Middle East and North Africa (MENA) region, namely, Algeria, Egypt, Iran, Morocco...
متن کاملThe Design of the Best Heat Integrated Separation Systems Using Harmony Search Algorithm
The synthesis of heat integrated multi-component distillation systems is complex due to its huge search space for structural combination and optimization computation. To provide a systematic approach and tools for the synthesis design of distillation systems, a new method for modeling heat integrated columns is presented, and the operating cost objective function is minimized by improved harmon...
متن کاملThe Effect of Web-Integrated Instruction and Feedback on Self-Regulated Learning Ability of Iranian EFL Learners
Abstract The present study intended, firstly, to investigate the effect of web-integrated instruction on self-regulated learning ability in EFL writing, and secondly, to compare and contrast the effects of paper-based feedback and web-assisted feedback on the self-regulated learning ability. To this end, a quasi-experimental design was applied for both cases. In line with the first objective, ...
متن کامل